Skip to content

Conversation

@mattf
Copy link
Collaborator

@mattf mattf commented Oct 4, 2025

What does this PR do?

close the _model_cache abstraction leak

Test Plan

ci w/ new tests

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Oct 4, 2025
@mattf
Copy link
Collaborator Author

mattf commented Oct 4, 2025

@ehhuang ptal

"""
return {}

async def get_models(self) -> Iterable[str] | None:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we make this name a bit easier to understand w.r.t. the rest of the methods we have? get_ vs list_ etc? it is not very clear what the semantics of this one is immediately.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

renamed get_models -> list_provider_model_ids

Copy link
Collaborator

@leseb leseb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the careful handling of multiple iterator types.

@mattf mattf merged commit 724dac4 into llamastack:main Oct 6, 2025
21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants